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We review various features of the statistics of random paths on graphs. 
The relationship between path statistics and Quantum Mechanics (QM) 
leads to two canonical ways of defining random walk on a graph, which 
have different statistics and hence different entropies. Generic random walk 
(GRW) is in correspondence with the field-theoretical formalism, whereas 
maximal entropy random walk (MERW), introduced by us in a recent work, 
is motivated by the Feynman path-integral formulation of QM. GRW max- 
imizes entropy locally (neighbors are chosen with equal probabilities), in 
contrast to MERW which does so globally (all paths of given length and 
cndpoints are equally probable) . The stationary distribution for MERW is 
given by the ground state of a quantum-mechanical problem where nodes 
whose degree is smaller than average act as repulsive impurities. We in- 
vestigate static and dynamical properties GRW and MERW in a variety of 
examples in one and two dimensions. The most spectacular difference arises 
in the case of weakly diluted lattices, where a particle performing MERW 
gets eventually trapped in the largest nearly spherical region which is free of 
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impurities. We put forward a quantitative explanation of this localization 
effect in terms of a classical Lifshitz phenomenon. 

PACS numbers: ll.10.Ef, 05.40.Fb, 89.70. Cf, 72.15.Rn 

1. Introduction 

This paper presents a review of various facets of the statistics of random 
walks on graphs and other geometrical structures. Brownian motion has 
been proposed in the seminal works by Einstein [1] and Smoluchowski [2] 
as a microscopic theory for diffusive transport. Random walk (RW) models 
stem from a discretization of Brownian motion. The discretization proce- 
dure can be motivated either on theoretical grounds (it provides a cutoff 
regularizing the short-distance singularities which plague the continuous 
Brownian motion) or by practical considerations (it makes numerical simu- 
lations easier). There are many incarnations of RW, where either space or 
time is separately considered as discrete or continuous. The most celebrated 
ones include the Polya walk on a lattice and continuous-time random walk 
(CTRW) [3]. RW is such a natural construction that it has altogether been 
used across the whole realm of sciences. We refer the reader to [4] for an 
exposition of the probabilistic foundations of Brownian motion and RW, 
and to [5] for a discussion of a range of applications in the physical sciences. 

In this paper we consider for definiteness discrete-time RW on lattices 
(or graphs in general). Within this context, RW is a Markov chain which 
describes the stochastic trajectory of a particle (random walker) taking suc- 
cessive random steps. For instance, in the well-known case of the Polya 
walk on a lattice, at each time step the particle jumps at random onto one 
of the neighboring nodes. The walk thus generates a random path on the 
lattice. 

The relationship between RW and the statistics and entropy of paths is 
the main thread of this paper. In Section 2 we review various features of the 
statistics of paths. We recall how to count paths by means of the adjacency 
matrix A of a graph. We then present the relationship between RW and 
path integrals. The Feynman path-integral formalism [6] for a free particle, 
where trajectories are weighted only by their length, suggests that all paths 
of given length and endpoints should be equally probable. At variance with 
this picture, the field-theoretical approach to a relativistic particle propa- 
gating in a curved background requires that paths of the same length are 
not equally probable, but rather that their statistical weights depends on 
the nodes through which they pass. Both formalisms only agree in the par- 
ticular case of fc-regular graphs, where all the nodes have the same degree. 
Section 3 is devoted to RW models on an arbitrary graph. The main em- 
phasis is put on two different canonical ways of defining RW, namely generic 



3 



random walk (GRW) and maximal entropy random walk (MERW), respec- 
tively corresponding to the field-theoretical and path-integral formalisms. 
In generic random walk (GRW), the particle sitting at a node of degree k 
jumps onto any neighboring node with uniform probability 1/k, maximizing 
thus the entropy production locally, albeit not globally. In the stationary 
state, the probability ir a of finding the particle at node a is proportional 
to the degree k a . When the lattice is regular (i.e., all nodes have the same 
degree), all paths of a given length between two given points are equally 
probable, and thus have maximal entropy. Nevertheless, in accord with 
the field-theoretical formalism, as soon as the graph is not regular GRW 
trajectories are no longer equally probable. 

We then turn to maximal entropy random walk (MERW). This novel 
kind of RW has been put forward and investigated by us in a recent work [7] . 
It is defined in such a way as to ensure that all paths of given length and 
endpoints are equally probable, in accord with the Feynman path integral. 
In other words, MERW is meant to maximize entropy globally, albeit not 
locally. It is still a Markov (memoryless) process, defined by local but non- 
trivial rules involving the largest eigenvalue of the adjacency matrix of the 
graph and the associated Perron-Frobenius eigenvector. The latter appears 
as the ground state of a quantum-mechanical tight-binding Hamiltonian, 
where the nodes a whose degree k a is smaller than the maximal degree fc max 
carry a repulsive site potential V a = fc max — k a . In the stationary state, the 
probability 7r a of finding the particle at node a is given by the square of the 
component ip± a of the Perron-Frobenius eigenvector. As a byproduct, we 
introduce three definitions of the effective degree of a graph. The connection 
between RW, and especially GRW and MERW, and stochastic quantization 
is then made in Section 4. 

In the rest of the paper we make a comparative investigation of GRW and 
MERW. A variety of examples of finite graphs are dealt with in Section 5, 
including bipartite and linear graphs. Section 6 is devoted to extended 
one-dimensional structures (ladder graphs). As a general rule, the effect 
of the repulsive potential on a particle performing MERW extends over 
the whole system. We consider successively the situation of one or two 
repulsive impurities, the converse situation of an attractive impurity where 
the stationary distribution is carried by a localized impurity state, and 
the case of a weakly diluted graph, obtained by removing a small fraction 
of bonds at random. The higher-dimensional situation is illustrated by 
several two-dimensional examples in Section 7. It is shown that MERW 
can lead to better transport properties than GRW, on the example of a 
non-bipartite two-dimensional lattice, the dual (4, 8 2 ) lattice. In the case 
of weakly diluted lattices, obtained by removing a small fraction of bonds 
at random, it is shown that any small amount of disorder is sufficient to 
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localize the stationary state of MERW in the largest nearly spherical region 
which is free of defects. This unexpected localization effect takes place in 
any dimension. We provide a quantitative explanation for it in terms of a 
classical Lifshitz phenomenon. 

The interested reader is referred to the interactive MATHEMATICA 
demonstration by one of us (BW) for many more illustrations of the unusual 
static and dynamical features of MERW [8] . 

2. Statistics of paths 

2.1. Enumerating paths on a graph 

A path is a very common object in graph theory (see, e.g., [9], [10]). It 
is a finite sequence of adjacent (neighboring) nodes on a graph. Its length 
is defined as the number n of steps of the path. Each step follows a link 
(bond, edge) of the graph. 

In this paper we consider only undirected graphs, i.e., graphs whose 
edges have no orientation. We first recall how to enumerate paths {"Yba(n)} 
of length n going from node a to node b on a finite connected graph. 
Throughout this paper we use notations consistent with those used in QM: 
the initial (resp. final) state is the second (resp. first) index of transi- 
tion matrices or propagators. The number iV& a (n) of paths {'Jba( n )} can be 
calculated recursively as 

N ba (n + l) = J2 A bcNca(n), (2.1) 

c 

where A = (A ab ) is the adjacency matrix of the graph: 

. J 1 if a, b are neighbors, , , 

Aab ~ \ otherwise. [ > 

For a finite undirected graph with N nodes, A is a symmetric N xN matrix. 
We have 

Y, A ab = k a , (2.3) 

b 

where k a denotes the degree (number of neighbors) of node a, and 

trA 2 = ^2k a = 2L, (2.4) 

a 

where L is the number of links of the graph. 
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Applying the recursion relation (2.1) n times to the initial condition 
N ba {0) = $ba, where S ba is the Kronecker delta, one obtains 

N ba (n) = (A n ) ba = ^2 M ia X^ (2.5) 

i 

where A n is n-th power of the adjacency matrix, and ipi denote the normal- 
ized eigenvectors of A associated with the eigenvalues A«: 

Aft = Wt, J>f a = l. ( 2 - 6 ) 

a 

The second index of ipi a denotes a-th component of ipi. The N eigenvalues 
are assumed to be ordered so as to have decreasing absolute values: |Ai| > 
| A.2 1 > • • • In the large-n limit, the sum (2.5) is dominated by the largest 
eigenvalue Ai of the adjacency matrix. 

After Boltzmann, Gibbs, and Shannon, the entropy H ba {n) of the en- 
semble of paths {^ba{n)} is defined as the logarithm of the number of paths: 

H ba (n) = In N ba (n). (2.7) 

For n — > oo, this entropy grows as 

H ba (n) pa n In Ai + \n(ip lb ip la ) . (2.8) 

The leading term is independent of the positions of the endpoints a, b. So, 
for large n, the entropy density per step (also called entropy production 
rate) , 

h= lim = ]nAi, (2.9) 

n— >oo n 

only depends on the largest eigenvalue Ai of the adjacency matrix A. The 
concept of entropy production can be generalized to a broader class of 
Markov chains, where the transition probabilities also depend on some field 
defined on the graph [11]. 

Under the mild hypothesis that the adjacency matrix A is primitive (or 
regular, see [12]), it follows from the Perron-Frobenius theorem that Ai is 
positive, whereas all the other eigenvalues are strictly smaller in modulus, 
and that the corresponding eigenvector ipi can be chosen so as to have 
strictly positive components: Via > 0. In the present situation of undi- 
rected graphs, the matrix A is symmetric and its spectrum is real. The 
primitiveness hypothesis thus only excludes the case of bipartite graphs, 
which can be dealt with separately (see Section 5.2). For a bipartite graph, 
we have A2 = — Ai, and hence N ba (n) oscillates with n, so that Eq. (2.8) 
possesses an additive oscillating contribution of order unity. 
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2. 2. The path integral of a free relativistic particle 

An interesting application of the statistics of paths is the description of 
a free relativistic particle. In the Feynman formulation of QM, quantum 
amplitudes are calculated as path integrals [6]. For a particle propagating 
in d-dimensional Minkowski spacetime, the amplitude is given as an integral 
over spacetime trajectories x& a (r) going from an initial spacetime point a 
to a final one b: 

G ba = j[Dx ba (r)} eH^M], (2.10) 

where H is Planck's constant. The action of a free scalar particle is S = 
Mc J^ds, where ds 2 = (dx ) 2 — (dx) 2 is the spacetime interval, and M is 
the mass of the particle. The spacetime coordinates of point x = (ct, x) 
will be denoted by x M (fi = 0, 1, . . . , d — 1) and the speed of light as well as 
Planck's constant will be set to unity for convenience: h = c = 1. One way of 
performing the integral (2.10) is to use the Wick rotation (x°,x) — > (ix°,x) 
and to calculate a related quantity, called the Euclidean propagator (or 
Euclidean kernel). One then rotates the result back to the Minkowskian 
sector. Under Wick's rotation, the spacetime interval ds 2 = (dx ) 2 — (dx) 2 
transforms to — ds 2 = — ((dx ) 2 + (dx) 2 ) . The Euclidean propagator is 
defined by taking a proper branch of the square root of V— ds 2 : 




(2.11) 



where the free-particle action 

S[x(t)] = M J dryV^^ = M j As (2.12) 

is proportional to the length of the corresponding Euclidean trajectory. 
Here rj = (rj^u) = diag(l, . . . , 1) denotes the Euclidean metric tensor and 
the Einstein summation convention is used. The trajectory r i-> x(r) is 
parametrized by its proper time r. The dots denote derivatives with re- 
spect to r. The action S[x(t)] is invariant with respect to diffeomorphic 
reparameterizations of the trajectory, so that the choice of parametrization 
does not play any role. 

The Euclidean propagator (2.11) calls for a probabilistic interpretation, 
as the integrand is positive. A good way of emphasizing this feature is 
to use a lattice regularization. This is a standard strategy in field theory: 
one discretizes spacetime, calculates the propagator, and then takes the 
continuum limit by sending the lattice spacing to zero (see, e.g., [13]). If 
one does this carefully, the outcome is independent of the discretization and 
all the symmetries of the underlying continuum theory are restored. Finally, 
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the results are rotated from the Euclidean sector back to the Minkowskian 
one. In order to show how this works, let us consider the case where the 
continuous spacetime R d is discretized into the hypercubic lattice with 
lattice spacing e. The integral over all possible trajectories from a to b in 
the Euclidean propagator (2.11) is replaced by a sum over all possible paths 
between a and b: 

G ba = ^ ^(7fea) e-^H (2.13) 

{iba} 

where (i = Me, ra[7& a ] is the length of 7b a , equal to the number of edges 
along this trajectory, and W(jba) are statistical weights corresponding to 
the integration measure [Dxft a (i)] defining the ensemble of trajectories in 
Eq. (2.11). At variance with the non-relativistic case, in relativistic QM 
trajectories may go back and forth in the time direction. A trajectory which 
locally goes backward in time is interpreted as an antiparticle propagating 
forward in time. Turning points, where the trajectory changes its time 
direction, correspond to particle-antiparticle creation or annihilation events 
(see Figure 1). 




x 



Fig. 1. Left: Example of a path on a 2D lattice. Right: the same path is interpreted 
as a trajectory of a relativistic quantum particle in (l+l)-dimensional spacetime. 
Arrows show the direction of time, whereas black circles are creation/annihilation 
events. 

Now, an interesting question arises: how should the weights {W(-yba)} 
be chosen in order to obtain the correct relativistic Quantum Mechanics? 
The most natural choice consists in setting all W(-jba) to be equal. In other 
words, all the possible trajectories with a given length are assumed to be 
equally probable. Although this is the right prescription for paths on regular 
lattices, we shall see that this choice stands in contradiction with another 
formulation of QM if the underlying lattice is not regular. Yet, let us first 
consider the case where W(jba) = F Eq. (2.13) can then be viewed as the 
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Laplace transform of the number of trajectories of length n, 



£e-^iV 6a (n) = J>-^" (A n ) 



ba 



n 



n 



(i-e-^) 6 -;=E 



(2.14) 



l-e-"Ai' 



where we denoted the identity matrix by 1 = (5 a b)- The Euclidean propa- 
gator is thus directly related to the statistics of paths, and to the adjacency 
matrix A. It has a first singularity (simple pole) for fi — > InAi. 

The generalization of the above construction to a curved spacetime is 
straightforward. In discrete quantum gravity models curved backgrounds 
are discretized using simplicial manifolds [14]. Such a manifold consists 
of equilateral (i-simplices which are put together to form a tf-dimensional 
manifold. In d = 2 dimensions we obtain an equilateral triangulation [15]. 
One can additionally impose a causal structure by introducing a foliation 
which singles out the temporal direction. This approach involving causal 
dynamical triangulations, referred to as Lorentzian simplicial gravity [16], 
is also extensively used to discretize path integrals in quantum gravity. The 
Euclidean action of a free particle in a curved background is 



where is the metric tensor, so that the action is, as before, proportional 
to the length of trajectory. Assuming again weights W(% a ) = 1, the Eu- 
clidean propagator is given by the same formula (2.14) as in flat spacetime, 
except that now A is the adjacency matrix of the graph representing the 
non-trivial geometrical background in which the particle propagates. One 
can alternatively consider paths on a graph dual to the given simplicial 
manifold. This graph is /c-regular with k = d+ 1. The corresponding paths 
pass through the centers of the simplices of the manifold. 



Let us now discuss an alternative derivation of the Euclidean propaga- 
tor. A free relativistic particle propagating in a given background can be 
described by a free field (see, e.g., [17]) with action 



where $ = $(x) is a scalar field and g^ v = g tJLV {x) is the metric tensor at 
the spacetime point x. We consider here only the Euclidean sector, i.e., g^ v 




(2.15) 



2.3. Field-theoretical approach 




(2.16) 
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having the Euclidean signature (+, +,..., +). The matrix g^ v is the inverse 
of g^ u , and g = det(g fMU ). Integrating the first term by parts and assuming 
that boundary terms vanish, one obtains 

S=^Jd d x^/g-<S>(-V 2 + M 2 )<S>, (2.17) 

where 

V 2 = ^=J-V9<rJ- (2-18) 

y /gdx^ yyy dx u y 1 

is the Laplace-Beltrami operator. The Euclidean propagator is defined as 
the two-point correlation function 

G(x,y) = iy [D$] e~ s , (2.19) 

where Z = f [D<J>] e~ s and [D<3>] is the integration measure for a scalar field 
in the given geometrical background. The meaning of the latter measure 
becomes clear if one discretizes the geometry, using an equilateral graph with 
fields {(p a } located at the nodes. The integration measure is assumed to be 
a product measure [D<£] = rL^a- This ^ s * ne same kind of assumption 
as was made about the weights {W^(7ba)} in Section 2.2. This assumption 
is validated by the fact that it leads to the same propagator as the one 
obtained from the Klein-Gordon equation of motion of the scalar field. The 
discretized action reads 



S = \ E ~ <t>b? + ^" E fc X (2-20) 

ab a 

or, equivalently, 

S = \j2^(- A ^ + m 2 k a S ab )(l> b , (2.21) 

ab 

where k a denotes the degree of node a, and 

A a6 = -k a S ab + A ab (2.22) 

is the topological (or graph) Laplacian. Note that the sign of this opera- 
tor is opposite to that commonly used in graph theory. We use this sign 
convention because we want the graph Laplacian to become the Laplace op- 
erator in the continuum limit. As a consequence, all eigenvalues of this 
operator are non-positive. The correspondence between the dimension- 
less discretized quantities and those in the original continuum theory is 
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<&(x) o e 1 d / 2 a , M 2 o e 2 m 2 , d^Xy/g o e d /c a , where e is the lattice spac- 
ing. The Laplace-Beltrami operator is discretized as the lattice Laplacian: 
d d x^gV 2 o e d ~ 2 A ab . 

The discretized Euclidean propagator is given by the Gaussian integral 

° ba = \ / II d ^ c exp (^~\ X] ^ c (~ A ^ + m2k cS c d) <Pdj , (2.23) 



which can be done explicitly: 

1 



G ba = -±= (m 2 l - A) 1 = -^G ba , (2.24) 

\ kukn \ / ba \/Khkn 



where 



G ba =(l- e^A) 1 . (2.25) 

V J ba 



The normalized graph Laplacian A is defined by A ba = A ba /y/k b k a , whereas 
A is a matrix with entries A ba = A ba j \/k b k a , and ft = ln(l + m 2 ). The 
geometric series expansion of (2.25) yields powers of the matrix A of the 
type (A n ) ab , which are nonzero only if all the factors A ca - in the product 
represent adjacent edges of the graph. In other words, (A n ) ba generates 
paths on the graph, each with some statistical weight. We thus obtain 

Gba = ^2e-» n (A n ) ba = y^k~ a ^ nhba] II jp ( 2 - 26 ) 

n {76a} C S76a ° 



Comparing Eqs. (2.14) and (2.26), we see that both approaches lead to 
different propagators for a free particle on a graph representing a discretized 
curved background. The main difference is the following. In Eq. (2.14) all 
paths have equal weights W{^ ba ) = 1, as they are just weighted by an 
exponential factor depending on the path's length, whereas in Eq. (2.26) 
paths have an additional weight W{^ ba ) = \Jk b k a X\ c< z lba iX / k c ) . Thus, the 
path-integral formulation which is consistent with the field-theoretical ap- 
proach requires that paths of the same length are not equally probable, but 
rather that their statistical weights depends on the nodes through which 
they pass. In the particular case of fc-regular graphs, i.e., graphs for which 
all nodes have the same degree k, (2.14) and (2.26) are equivalent. Indeed, 
since the weights W(-j ba ) = k~ n ^ ba ^ only depend on the length of paths, the 
propagators can be mapped onto one another through /j, = fi + In k. 
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3. Random walks on a graph 



So far we have discussed the statistics of paths and its relationship to 
path integrals. Another area where the statistics of paths naturally arises is 
random walk on graphs. Random walk is a stochastic process, providing a 
microscopic representation of diffusion, which describes a particle (or a gas 
of non-interacting particles) hopping between the nodes of a graph. One is 
interested in the probability Pba(T~) that a particle, which was initially at 
node a, is at node b at the later time r. We will consider only discrete- 
time random walks, such that the particle hops to a neighboring node of 
the graph at each time step. Graphs can be treated as a discretization of 
a geometrical background in which diffusion takes place. In this case one 
usually wishes to restore the continuum theory by sending the lattice spacing 
and the time interval to zero in a proper way (diffusive scaling). Graphs 
may also model real discrete structures. In this case there is no reason to 
invoke a continuum limit. For instance, complex networks are commonly 
used to model the Internet, the worldwide airline network, social networks, 
and so on [18]. In this context, random walk may describe the propagation 
of information, passengers, etc. 



Discrete-time random walk on a finite connected graph is an irreducible 
Markov chain. The stochastic motion of the particle is encoded in transition 
probabilities {Pba} that a particle sitting at node a will hop to node b at the 
next time step. One can collect the transition probabilities in a transition 
(or Markov) matrix P = (Pba) (see [19]). The matrix P fulfills the conditions 
for being a stochastic matrix: the probabilities are non- negative (Pb a > 0), 
while the entries in each row sum up to unity: X^-Pfia = 1; ensuring the 
conservation of probability. We will only consider transition matrices which 
conform with the structure of the undirected graph, that is for any pair 
(a, b) of neighboring nodes we have A a b = A^ a = 1, and P a b > 0, Pb a > 0, 
although P a b ^ P^ in general. All the other entries of P (including the 
diagonal ones) are zero, so that in a single time step the particle may only 
hop to a neighboring node. 

Using the transition matrix P, one can write a recursive relation for the 
probabilities Pba(i~)'- 



3.1. Generalities 




(3-1) 



c 



which is analogous to the combinatorial formula (2.1). Solving it with 
the initial condition pb a (0) = 5b a , corresponding to the particle starting 
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at node a, one obtains 

Pba(r) = (P T ) ba , (3.2) 

which is again analogous to Eq. (2.5). The interpretation of both formulas 
is different: (2.5) has a combinatorial meaning, while (3.2) has a proba- 
bilistic one. There is, however, a strong similarity between both problems, 
namely that they can be formulated in terms of path statistics. A particle 
performing a random walk on a graph marks a trajectory of consecutive 
nodes visited during the walk. The length n of this path is equal to the 
time (number of steps) r of the random walk. Let 7<j T a = (flr, • • • , «i,ao) 
be a path of length r from ao to a T . For fixed endpoints ao and a T , the 
probability that the path visits the given sequence of nodes reads 

P(ria T ao) = Pa T a T -\ ' ' ' Paia\Pa\au- (3-3) 

The paths generated by the Markov chain representing the random walk 
may thus have in general different statistical weights, in contrast to the 
combinatorial problem where each path is counted with the same weight, 
independently of the intermediate nodes. 

One case of much interest is generic (ordinary) random walk (GRW), 
generalizing the Polya walk on a lattice, which will be investigated in Sec- 
tion 3.3. Neighbors are selected uniformly at each time step, i.e., P ba = 
Ab a /ka, and hence 

T- 1 1 

P(la T a ) = II — , (3.4) 
i=0 ai 

which is the same weight as in (2.26). Therefore, the trajectories enter- 
ing the field-theoretical derivation of path integrals are the same as those 
generated by GRW. For GRW on /c-regular graphs, there is a simple cor- 
respondence between the combinatorial result (2.5) and the probabilistic 
one (3.2). One can interpret Nt, a (n)/k n as the probability Pbai^) of reach- 
ing node b after r = n steps, starting from a, since the numerator Nb a (n) 
is the number of paths of length n between a and b, while the denominator 
k n is the number of paths of length n starting from a and ending anywhere. 

A natural question arises: Can one find a stochastic matrix which gener- 
ates trajectories between given endpoints with uniform weights, irrespective 
of intermediate nodes, for an arbitrary (non-regular) graph? In other words: 
Is there a random walk such that all trajectories between two given endpoints 
are equally probable? A positive answer to the above question is provided by 
maximal entropy random walk (MERW), to be investigated in Section 3.4. 

Before this, let us recall some basic properties of the Markov chain de- 
fined by the transition matrix P. As already mentioned, we will restrict 
ourselves to the situation where the transition matrix is primitive. In this 
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case, the probability distribution Pb a (T~) tends to a limiting distribution 
linv^oo Pba(T~) = iTb, independently of the initial point a. This unique dis- 
tribution is given by the normalized left eigenvector of the stochastic matrix 
corresponding to unit eigenvalue: 

a a 

3. 2. The entropy of a random walk 

Let us denote by P(a T , . . . , a±, ao) the probability that a random walker 
follows a path ao — > a\ — > . . . — > a T . The Markov property expressed by the 
master equation (3.1) implies that this probability reads 

P(a T , . . . ,ai,a ) (0), (3.6) 

where 7r(0) is the probability distribution of the initial point. 

We define the entropy H T of the ensemble of paths of length r as: 

H T = - ^2 P(a T ,...,a 1 ,a )\nP(a T ,...,a 1 ,a ), (3.7) 

ao,ai,...,a T 

where the sum effectively runs over all the allowed paths of length r gen- 
erated by the master equation (3.1). Inserting Eq. (3.6) into (3.7), we find 
that the entropy is asymptotically produced at a constant rate, /iRw = 
lirn^oo (H t /t), which reads 

hRW = - ^Z^a^Pba In Pba , (3.8) 
a b 

independently of the initial distribution 7r(0). This means that after a long 
time, when the process has reached its stationary state, the entropy produc- 
tion rate is equal to a local production rate, h a = — Pb a hi Pb a , averaged 
over TT a . The stationary distribution 7r a is itself entirely determined by the 
stochastic matrix P defining the random walk (see Eq. (3.5)), and so is the 
entropy production rate (3.8). 

In the following we shall compare the entropies of two different types 
of random walk: generic random walk (GRW), which locally maximizes en- 
tropy production, as already mentioned earlier, and maximal entropy ran- 
dom walk (MERW), which maximizes entropy globally. 

3.3. Generic random walk (GRW) 

Generic random walk (GRW), generalizing the Polya walk on a lattice, 
has already been defined above Eq. (3.4). The particle sitting at node a 
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with degree k a hops to one of the neighboring nodes b without giving a 
preference to any of them, i.e., with probability l/k a , so that 

P ba = 4r- ( 3 - 9 ) 

This maximally random choice at each time step corresponds to a local max- 
imization of the entropy production. The local entropy h a = — Pba m Pba 
is indeed maximized for the uniform selection of neighbors (3.9). One 
may ask whether this choice also maximizes the entropy production rate 
^-RW (3-8) of entire paths. We expect that it does not, because the sta- 
tistical weights of paths for GRW are given by Eq. (3.4) and hence paths 
are not equally probable in general, even if they have identical length and 
endpoints (see Figure 2). 




Fig. 2. (Color online). Two paths (solid and dashed line) on a graph with the 
same endpoints and length, but different statistical weights in GRW, because they 
pass through different nodes. Skipping probabilities attached to the endpoints, the 
solid path has probability 1/4 • 1/3 • 1/4 • 1/4 = 1/192, whereas the dashed one has 
probability 1/4 ■ 1/3 • 1/3 • 1/4 = 1/144. 

The stationary distribution -K a obtained from (3.5) for GRW reads 

VTa = (3.10) 



The stationary probabilities of GRW are directly proportional to the node 
degrees. This is to be contrasted with Eq. (3.4), which states that the 
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contribution of intermediate nodes to the weight of a given path is inversely 
proportional to their degrees. 

Inserting Eq. (3.10) into (3.8), we find the entropy production rate /igrw 
of generic random walk in the form: 

hGRW = Jjr^ka^ka. (3.11) 

a 



3.4- Maximal entropy random walk (MERW) 

We now turn to the question raised in Section 3.1. If there is a random 
walk which maximizes entropy, we expect that all paths of given length 
between two given endpoints will be equally probable. The weights of paths 
may however still depend on the endpoints, as the contribution of endpoints 
will eventually disappear in the limit r — > oo, as it did in Eq. (2.9). We 
are therefore looking for a stochastic matrix P such that the weight (3.3) 
is a function of length r and endpoints a, b only. Moreover, as we expect 
that the matrix P should have entropy h = InAi, the construction must 
somehow be related to the largest eigenvalue of the adjacency matrix. 

It can be checked that maximal entropy random walk (MERW) [7], 
defined by the following transition probabilities: 

P ba = (3-12) 

Al fla 

fulfills all the requirements. First, P is a stochastic matrix. The components 
ipia of the eigenvector corresponding to the largest eigenvalue Ai are all 
positive, by virtue of the Perron-Frobenius theorem. One can check that 
the row sums are equal to unity: Ylb^ba = 1- Finally, MERW conforms 
with the graph structure. 

The stationary distribution (3.5) for MERW can be checked to be given 
by the squared components of the normalized eigenvector ipi: 

7r a = (3-13) 

so that the L 1 normalization (3.5) of the 7r a nicely matches the L 2 normal- 
ization (2.6) of the ipi a . Inserting the above result into (3.8), we obtain an 
expression for the entropy production rate, 



fiMERW = In Ai = h, (3.14) 

which indeed coincides with the combinatorial entropy of paths (2.9). It 
can also be checked that the statistical weight (3.3) for a path ja T a { , = 
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(a T , . . . , ai, ao) is independent of intermediate nodes. Indeed, inserting (3.12) 
into (3.3), we obtain 

P{la T a ) = (3.15) 

This expression only depends (exponentially) on the path length r, and on 
the endpoints ao and a T , through the components of This means that 
all paths of length r from a to a T are indeed equally probable. In other 
words, the probability measure on this ensemble of paths is uniform, and 
the corresponding entropy is maximal. 

To the best of our knowledge, MERW has been introduced and studied 
for the first time in our recent work [7] in the context of random walk 
and path integrals. However, the construction of stochastic processes with 
maximal entropy in the framework of information theory is much older, as it 
dates back to Shannon [20]. The concept has been formalized by Parry [21] 
as intrinsic Markov chains. In the context of ergodic theory, the stationary 
distribution (3.13) is referred to as a Shannon-Parry measure [22], whereas 
yet other related matters are discussed in Refs. [23] and [24]. 

The Perron-Frobenius eigenvector tpi can be interpreted as the ground 
state of the Hamiltonian H = (H^), with H a \y = k max 5 a b — A a ^ = —A a b + 
Va&ab-, where V a = k max — k a , and k nmx is the maximal node degree in the 
graph. In other words, ipi is the ground-state wavefunction of the tight- 
binding equation 

{HlPi) a = (-A^)a + V a ^ ia = E^ ia , (3.16) 

with 

V a = k max — k a , Ei = /c max Aj, (3.17) 

and the stationary distribution (3.13) is the square of this ground-state 
wavefunction. The potential V a is non-negative. It is positive (i.e., repul- 
sive) for nodes whose degree is smaller than k max — the smaller the degree, 
the larger the repulsion. All the eigenvalues Ei of H are clearly non-negative, 
the ground-state eigenvalue E\ = k max — X\ being the smallest one. For a k- 
regular graph, the potential vanishes identically. The Hamiltonian H thus 
describes the propagation of a free particle. The ground-state energy is 
Ei = and we have ip\ a = 1/y/N, so that ir a = 1/N, where iV is the num- 
ber of nodes of the graph. Hence the stationary measure n a is uniform over 
the /c-regular graph. 

3.5. Effective degrees 

It is interesting to illustrate the above considerations by associating ef- 
fective degrees to the entropies of GRW and of MERW on a graph. Consider 
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an arbitrary finite graph whose N nodes (a = 1, . . . , N) have degrees k a . 
We introduce the following three definitions of its effective degree: 

• The first effective degree of a graph is simply its mean degree, 



i o T 

K ^=N^=N- (3 - 18) 

a 



The node degrees k a indeed sum up to twice the number of links L 
(see (2.4)). 

• The second definition is the GRW-based degree K 2 = exp(/iGRw) ; 
where the entropy /jqrw °f GRW is given by (3.11), hence 

K2 = 6XP (2I S K ln = (ll ■ ( 3 - 19 ) 

• The third one is the MERW-based degree K3 = exp(ZiMERw)) where 
the entropy /imerw of MERW is given by (3.14), hence 

K 3 = Xl (3.20) 



The intuition behind the entropic definitions of the effective node degrees 
K 2 and K3 is the following. On a fc-regular graph, the number of paths of 
length n starting from a given node grows as N(n) = k n , so that the degree k 
is related to the entropy production rate as k = exp(/t). A natural extension 
of this relation to irregular graphs leads to (3.19) or (3.20) if one uses the 
local or global rule for maximal entropy production, respectively. 

The three definitions of the effective degree yield in general different 
values. Their number-theoretical natures are very different: K\ is a rational 
number, whereas if 2 is a fractional power of an integer, and K3 is a solution 
of an algebraic equation of degree at most N. The effective degrees obey 
the inequalities 

fcmin <K X <K 2 <K Z < fc max , (3.21) 

where fc m i n and fc max are the minimal and maximal values of the node de- 
grees. The first and fourth of these inequalities are obvious, whereas the 
third one just expresses that MERW indeed has maximal entropy, and the 
second one originates in the convexity of the free energy 

F(/3) = lnJ>f. (3.22) 

a 



We have indeed lnK 2 = F'(l) >hiK 1 = F(l) - F(0). 



18 



4. Stochastic quantization 

As already mentioned, the trajectories generated by a random walk can 
be used to define quantum amplitudes. In this section we make this state- 
ment more precise within the framework of stochastic quantization (see, 
e.g., [17]). As one can anticipate, MERW will reproduce the path-integral 
propagator (2.13), and GRW the field-theoretical propagator (2.26). 

Let us start with MERW. We consider paths generated by the stochastic 
matrix (3.12), and restrict ourselves to equilibrium paths, initiated from the 
stationary state (3.13). The probability of such a path is 

Peqilaroo) = P(a T , ■ Gti, a )vr a() = Q~ rh V>la T 1pla , G 4 - 1 ) 

with h = InAi, as one can see by multiplying (3.15) by Y>i ao - Keeping 
endpoints ao = a and a T = b fixed and summing over intermediate states 
cti, . . . , a T _i, we obtain a sum over all paths 76 a ( r ) from a to b of length r: 

p eq(76a) = Yl Pc q (b, a T ^, . . . , ai , a) = N ba (T)e- Th i> lb ^ la . (4.2) 

{76a} a r _i...ai 

If we now multiply both sides by an additional exponential weight e _/iT with 
a positive parameter p, > 0, and sum over all integer values of r from zero 
to infinity, we eventually obtain 

2> -AT J2 p e q (76a(r)) = ^ U G ba ^ la , (4.3) 

{76a (r)} 

where is the propagator derived in the path-integral formalism (2.14) 
with [i = ji + h. The above expression becomes singular as the sum diverges 
for {i — > 0, i.e., fj, — > h = InAi. This situation describes the limit of a 
massless particle, in which all paths of any length are equally probable. 
The right-hand side of Eq. (4.3) has a characteristic sandwich form where 
G a b stands between wave functions representing external states ipi a = v^a" 
(see (3.13)). 

We can now repeat the same construction for GRW with the stochastic 
matrix (3.9). As in the previous case, it is convenient to define a state 
function if) as the square root of the stationary probability (3.10): V> a = 
y/iia = \/k a / (2£). The probability of an equilibrium path reads 

T i 

Peqha T a ) = ^(«r, • • • ,ai,a )vr ao = VV V'ao V K T K -j— , (4.4) 

i=0 ai 
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as one can see by multiplying (3.4) by (3.10). Applying the same procedure 
as for MERW, we obtain 

oo 

E e ~ AT E P ^(lba(r)) = AG b J a , (4.5) 

{lta(r)} 

where G ba is equal to the field-theoretical propagator (2.26). As already 
mentioned, the two propagators are identical only for /c-regular graphs. In 
this case, the largest eigenvalue of the adjacency matrix is Ai = k, the 
entropy rate is h = Ink, n = p, + Ink, ip a = ip\ a = \fk/(2L), and the 
stochastic matrix of MERW (3.12) is identical to that of GRW (3.9). 

Let us conclude this section with a remark on the relationship with non- 
relativistic Quantum Mechanics. In the relativistic case discussed so far, the 
parameter r was treated as proper time. The Euclidean propagators, either 
in the path-integral approach (4.3) or in the field-theoretical formalism (4.5), 
were independent of r, since the latter variable was summed over. One can, 
however, treat r as a universal time in a non-relativistic spacetime, and view 
the graph (or lattice) as a discretization of space only, hence skipping the 
summation over r. This leads to a non-relativistic propagator for (d + 1)- 
dimensional QM: 

E P ^inba{r)) = ^ lb K ba {r)i>ia, (4.6) 

where K ba (r) (or alternatively K ba (r)) is defined as a sum over trajectories 
of fixed length r. The non-relativistic propagator is thus related to the 
Euclidean relativistic propagator by a Laplace transform: 

G5 a (A) = E^( T ) e_/iT - ( 4 - 7 ) 

T 

One can also explicitly add a time direction to the discretized theory by 
stacking ti-dimensional lattices on top of each other. Doing so, one obtains a 
(d+l)-dimensional foliated lattice whose time slices are identical clone copies 
of d-dimensional space. In this context, the trajectories of a particle form 
directed polymers, which never go backward in time (see Figure 3). Thus 
MERW generates maximally entropic directed polymers which are equally 
probable in an ensemble of polymers having fixed endpoints. This is not 
the case for directed polymers generated by GRW in a curved background, 
discretized as a non-regular lattice. 

5. Examples of finite graphs 

In what follows we discuss properties of the stationary state for GRW 
and MERW on various finite graphs. 
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Fig. 3. (Color online). Trajectories of a non-relativistic particle on a (1+1)- 
dimensional square lattice form directed polymers (a,b), whereas trajectories which 
turn back in time are excluded (c). Both (a) and (b) have the same length and 
hence they are equally probable within the MERW (path-integral) formalism. 

5.1. k-regular graphs 

As already mentioned, the simplest situation is that of a fe-regular graph, 
where all the nodes have the same degree k. Both GRW and MERW are 
defined by the uniform transition probabilities Pb a = 1/ A; if nodes a and b are 
neighbors. The two processes therefore coincide, no matter how complicated 
the topology of the graph is. The corresponding stationary distribution is 
uniform: ir a = 1/N for all nodes. We have consistently 

K 1 =K 2 = K 3 = k. (5.1) 

5.2. Bipartite graphs 

The next case, in order of increasing complexity, is that of bipartite 
graphs. We will consider the class of finite bipartite graphs such that all 
nodes in one subset of the graph have identical degree fei, while in the other 
subset all nodes have degree k 2 . The numbers of nodes of each type are then 
N\ = L/ki and N 2 = L/k 2 , where L denotes the number of links. For both 
GRW and MERW, the transition probabilities take two values: P 2 \ = 1/fci 
(if node a has degree k\ and node b has degree k 2 ) and P\ 2 = l/k 2 (if node a 
has degree k 2 and node b has degree k\ ) . The two processes therefore again 
coincide. The largest eigenvalue of the adjacency matrix is A = \/k\k 2 . 
The corresponding eigenvector obeys tpi : tp 2 = \fk[ : y/k^. The stationary 
distribution takes two values: 7Ti = k\/{2L) and tt 2 = k 2 /{2L). The effective 
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degrees read 

Kl = -^-, K 2 = K 3 = ^hh. (5.2) 

In other words, K\ is the harmonic mean of both degrees, whereas K 2 and 
K3 coincide with their geometric mean. These results hold irrespective of 
the size and topology of the graph. 

The first non-trivial example of a bipartite but non-regular graph cor- 
responds to k± = 2 and k 2 = 3. We have K\ = 12/5 = 2.4, whereas 
K 2 = K 3 = V6 = 2.449490. These two values are different, albeit very close 
to each other. 



5.3. The barred-square graph 

The barred-square graph shown in Figure 4 is the simplest example of 
interest of a non-bipartite graph. 




D 

Fig. 4. The barred-square graph. 



For GRW on this graph, the stationary distribution reads 

7TA = 7TB = — , 7T C = VT D = -, (5.3) 

so that we have /igrw = (hi 108)/5. The largest eigenvalue of the adjacency 
matrix is A = (y/Vf + 1)/2. The corresponding eigenvector obeys i/ja '■ ipc = 
(y/V7 + 1) : 4. Therefore, the stationary distribution for MERW reads 



7TA = 7TB = = 0.310634, ttq = 7Td = ^ 1 = 0.189366. (5.4) 

1 v' IT " 1 x' IT 

Finally, the effective degrees are 

K 1 = ^ = 2.5, K 2 = 108 1/5 = 2.550849, K 3 = ^ + 1 = 2.561553. 

(5.5) 

These three values are again very close to each other. 
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5.4- Linear graphs 

Consider now the family of linear graphs made of N > 3 nodes, as shown 
in Figure 5 for N = 7. 

• • • • • o 

1 2 3 4 5 6 7 

Fig. 5. The linear graph with N = 7 nodes. 



The endpoints (n = 1 and n = N) have degree 1, whereas the N — 2 
inner points (n = 2, . . . , N — 1) have degree 2. The mean degree thus reads 

(5.6, 

For GRW on the linear graph, the stationary distribution is 

7Ti = tt n = ^ ; TT n = ^-j (n = 2,...,N- 1), (5.7) 
and we have 

K2 = 2 (N-2)/(N-l)_ (5g) 

For MERW the stationary distribution is 

2 2 nir 

and we have 

K 3 = A = 2cos— — . (5.10) 
N + 1 v ; 

As the linear graph gets larger (TV — > oo), the three effective degrees 
converge to the limiting value 2, characteristic of the infinite chain, albeit 
at different rates: 

Kx=2-—, K 2 = 2-^^ + ---, K 3 = 2-^- + --- (5.11) 

The positive differences K% — K\, K 3 — and K 3 — K\ are respectively 
maximal for N = 4, 9, and 6. 

Figure 6 shows a comparison of the stationary distributions of GRW (5.7) 
and MERW (5.9) on the linear graph with N = 29 nodes. The effect of the 
endpoint impurities is strictly local in the case of GRW, as it only affects 
the distribution at the endpoints themselves. On the contrary, in the case 
of MERW we observe a non-local effect of the endpoints on the station- 
ary distribution, which varies smoothly at the scale of the whole graph. 
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Fig. 6. The stationary distributions (5.7) of GRW (empty symbols) and (5.9) of 
MERW (filled symbols) on the linear graph with N = 29 nodes. 



Rather paradoxically, the MERW-based effective degree K3 converges as 
1/iV 2 , whereas the other two have a slower linear convergence in 1/N. 

The above picture is generic. Statistical properties of MERW may differ 
drastically from those of GRW. We recall that the stationary distribution for 
MERW is the square of the ground-state wavefunction of the Hamiltonian 
involved in the tight-binding equation (3.16). The latter describes the mo- 
tion of a QM particle in the presence of a repulsive potential V a = fc max — k a , 
supported by the impurity nodes whose degree is smaller than k max . These 
impurities can be expected to generate strong, non-local effects. 

6. One-dimensional examples: ladders 

We now turn to the investigation of MERW on extended structures, 
starting from quasi one-dimensional systems — ladder graphs. The full 
graph consists of two symmetric closed chains of nodes connected by rungs 
(see Figure 7). It is a 3-regular graph on which, as we have learned, GRW 
and MERW coincide. 




-5 -4 -3 -2 -1 1 2 3 4 5 6 



Fig. 7. The full ladder. Periodic boundary conditions along the chains are assumed. 
In order to meet cases where MERW behaves in a non-trivial manner, 
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we remove some of the rungs [7] . Since the ground state is not degenerate 
and its wavefunction is expected to be symmetric w.r.t. the exchange of 
both lines of the ladder, it is sufficient to consider the tight-binding equa- 
tion (3.16) in the symmetric sector. This equation takes the form 

2^1a - 1pla-l ~ tpla+1 + V a lp la = E x ^\ a , (6.1) 

where E\ = 3 — Ai and 

y _ { if the rung at position a is present, ,g ^\ 

a ~ \ 1 if the rung at position a is absent. ^ ' ' 

For definiteness we consider ladders whose length (circumference) is an even 
number 2N. We will index nodes in each line by a = —N, . . . , N, and impose 
periodic boundary conditions by identifying nodes N and — N. 

6.1. A single impurity 

Let us first create a single impurity at the origin by removing the rung 
at node a = (see Figure 8). 



0.07 
0.06 
0.05 
= 0.04 
■S 0.03 
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0.01 
0.00 




-100 -50 50 100 



Fig. 8. Top: a ladder with one rung at a — removed. Bottom: Plot of the numer- 
ically obtained ground-state wavefunction ipi a for N — 128 (solid line) compared 
with (6.5) (dotted line). The impurity potential V a is also shown (dashed line, 
rescaled). 

The potential V a = 5 a o is concentrated on the impurity. Setting E\ = 
2(1 — cos^), i.e., Ai = 1 + 2cosg, with some unknown wavevector q, the 
(unnormalized) wavefunction reads 

faa = cos((iV- \a\)q). (6.3) 

The matching condition on the impurity yields the quantization condition 



2 sing tan(Nq) = 1. 



(6.4) 
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The ground state corresponds to the smallest positive solution q to the latter 
equation. In the most interesting situation, namely for large N, we have 
q rj w/(2(N + 2)), and hence 

1 . (|a|+2)7r 
■01a w — == sm — . (6.5) 



The presence of a single defect has a non-local effect on the stationary 
probability distribution. The latter distribution is maximal at a = N, 
i.e., at the node farthest from the removed rung, whereas it is minimal on 
the impurity. Although the potential is concentrated at a single node, it 
exerts a strong repulsion on a particle performing MERW. The situation 
is somewhat similar to that of long linear graphs, described in Section 5.4, 
where the endpoints of the finite linear chain acted as impurities whose 
effect was already non-local. 

6.2. Two impurities 
We now consider what happens when two rungs are removed at positions 



n and a = —n (see Figure 9). 




Fig. 9. Top: a ladder with two rungs at a = —n and a — n removed, for n — 
4. Bottom: Plot of the numerically obtained ground-state wavefunction ipi a for 
iV = 128 and n = 80 (solid line) compared with (6.9) (dotted line). The impurity 
potential V a is also shown (dashed line, rescaled). 

The impurity potential V a = 5 a ,n + S a ,- n an d the ground-state wave- 
function are again symmetric in a. The (unnormalized) wavefunction reads 

/ _ / cos((iV — n)q) cos(aq) {—n<a<n), ,„ „, 

Pla ~ \ cos((7V - \a\)q) cos(nq) (n < \a\ < N). [ ^^ ) 

The matching condition on the impurity yields the quantization condition 

sin q (tan(ng) + tan((iV - n)q)) = 1. (6.7) 
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For large N and n, the smallest solution reads approximately 

oi ~ min ( — , — | . (6.8) 

yi \2n'2(N-n)J V ' 

The ground-state wavefunction, and therefore the stationary distribution 
of MERW, essentially live on the larger part of the ladder which is free of 
defects. For n > N/2, this larger region is the central one. The ground-state 
wavefunction is well approximated by 

{1 air 

, cos — i—n < a < n), ,„ 

V2^ 2n y ~ ~ h (6.9) 

otherwise. 

6.3. A single attractive impurity 

One can also consider the reverse situation of attractive defects, i.e., 
nodes having a degree larger than average. The simplest example is provided 
by a "degenerate ladder" with a single rung at a = (see Figure 10). The 
nodes at the endpoints of the rung have degree k = 3, whereas all other 
nodes have k = 2. In this case the impurity potential reads V a = 1 — 5 a o- It 
is everywhere repulsive, except at the origin. The ground state can thus be 
expected to be localized around the origin. 




Fig. 10. Top: A ladder with a single rung at a = 0. Bottom: Plot of the numerically 
obtained ground-state wavefunction ipi a for N = 32 (solid line) compared with 
(6.12) (dotted line, hardly visible). The impurity potential V a is also shown (dashed 
line, rescaled). 

This is indeed what happens. Setting E± = 3 — 2 cosh 6, i.e., Ai = 
2 cosh 9, the (unnormalized) wavefunction reads 



V^ia = cosh((iV- \a\)6). 



(6.10) 
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The matching condition on the impurity yields the quantization condition 

2sinh0 tanh(iV0) = 1. (6.11) 

The ground state is the unique bound state, corresponding to the real solu- 
tion 6\ to the latter equation. In the situation of most interest, namely N 
large, we obtain a non-trivial limiting solution so that sinh6q = 1/2, i.e., 
9\ = ln((\/5 + l)/2), and hence Ai = y/5. The limiting normalized ground- 
state wavefunction reads 

e -|a|0i 

The particle performing MERW is localized in the vicinity of the attractive 
defect (rung). The stationary probability ir a = ipf a of finding the particle 
at a distance a from the defect falls off exponentially as exp(— 2|a|#i). The 
corresponding localization length is £ = l/6\ = 2.078087. 

The existence of a localized ground state implies that the effective degree 
K3 = Ai = y/5 = 2.236068 remains strictly larger than K\ = K2 = 2, even 
in the limit of an infinitely long system. 

6.4- Diluted ladders 

We now consider the disordered situation where impurities are dis- 
tributed at random all over the ladder with some concentration q. In other 
words, we consider a diluted ladder graph where rungs are removed, inde- 
pendently of each other, with probability q. The tight-binding equation for 
the ground state is given by (6.1), where the potential V a is a sequence of 
i.i.d. variables with the binary distribution 

y _ f with probability p, ,g . 

a I 1 with probability q = 1 — p. 

The problem therefore maps onto the one-dimensional tight-binding An- 
derson model with diagonal disorder. Generic features of this model, such 
as the density of states or the localization length, have been investigated 
at length. In the present situation, we are however chiefly interested in the 
ground state of the model on a finite system of length L. This question is 
related to the behavior of the density of states p{E) near the bottom of the 
spectrum (E — > 0). The latter is known to have the form of an exponen- 
tially small Lifshitz tail [25]. Lifshitz tails have been studied extensively, 
both from a mathematically rigorous standpoint [26] and in various physical 
contexts, including in particular the diffusion of particles in the presence of 
randomly placed absorbing traps [27] . 
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In the one-dimensional case, the Lifshitz argument goes as follows. Low- 
lying states are expected to live on long wells, i.e., ordered sequences of 
sites without impurities. Assume there is a well between sites b and c, i.e., 
V;, = V c = 1, whereas V a = for b < a < c. There will be an eigenstate 
living essentially on that well, and resembling the free mode on the well 
with Dirichlet boundary conditions at b and c, i.e., ipa ~ sin((a — b)ir/£), 
where £ = c — b is the length of the well. The corresponding energy is 
E « ir 2 /£ 2 . This line of thought can be used to estimate the fall-off of 
the density of states near the bottom of the spectrum (E — > 0). Long 
wells [l 3> 1) occur in the chain with an exponentially small probability of 
order jr . Eliminating t for the corresponding energy E, we thus obtain 

p(E) ~ exp . ( 6 . 14 ) 



Ve 

In the one-dimensional situation the above result is virtually exact, up to 
absolute prefactors involving oscillating functions [28]. The same picture 
can be used to estimate the ground-state energy E\ on a finite system. 
According to a well-known argument of extreme- value statistics, the typical 
length l\ of the longest well on a finite system of length L is such that p^ 1 
is of order 1/L. We therefore predict that the ground state is typically 
localized in a Lifshitz well of length 

* ~ (6 - 15) 

and that the corresponding energy reads 

Figures 11 and 12 show linear and logarithmic plots of the stationary 
distribution of MERW on disordered ladders, obtained by a numerical diag- 
onalization of the adjacency matrix for a system size L = 512. For q = 0.01 
(see Figure 11), the estimate (6.15) yields £ « 620. Both length scales L 
and £ are comparable, in agreement with the data showing a macroscopi- 
cally large "dome". For q = 0.1 (see Figure 12), we obtain £ « 59. Disorder 
is strong enough to observe the Lifshitz phenomenon, i.e., the localization of 
the stationary distribution in the longest region without defects, which ex- 
tends approximately between the positions —80 and —30, so that its length 
is indeed of order 50. The usual localization effect, i.e., the exponential fall- 
off of the wavefunction over a characteristic length given by the localization 
length £, is also clearly visible on the lower panel of Figure 12. 
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Fig. 11. Top: stationary distribution n a of MERW on one configuration of the 
disordered ladder for a size L — 512 and a density q = 0.01 of defects. Bottom: 
same data plotted on a logarithmic scale. The impurity potential V a is also shown 
(dashed line, rescaled). 
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Fig. 12. Same as Figure 11, for a density of defects q = 0.1. 

— 1/2 

Figure 13 shows a plot of E 1 against InL, for a concentration of 
defects q = 0.1, and system sizes L ranging from 20 to 960. The ground- 
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Fig. 13. Plot of the inverse square root of the mean ground-state energy on disor- 
dered ladders against InL, for sizes L — 20, . . . , 960 and q = 0.1. The solid line 
with slope l/(7r |ln0.9|) and a fitted intercept corroborates the estimate (6.16). 

state energy has been obtained by diagonalizing numerically the adjacency 
matrix, and averaging the outcome over many disorder configurations. The 
data fully confirm the Lifshitz prediction (6.16). Finally, let us mention 
that the effective degrees K\ = 3 — q and K2 ~ 3 — 2gln(3/2) k, 3 — 
0.810930 q depart linearly from the value 3 for an infinite ladder with a weak 
concentration q of defects, whereas K3 = 3 — E\ still goes asymptotically 
to 3, albeit with a logarithmic finite-size correction (see (6.16)). 



We close this section on ladders by considering a deterministic but non- 
periodic configuration of the removed rungs. We choose for definiteness 
the Fibonacci sequence 0100101001001010010100101001001. . . This infinite 
sequence can be built in two alternative ways: either recursively, or by an 
explicit formula [29]. In the first method, the sequence is built as the fixed 
point of the substitution: 



acting on the two symbols and 1, taking the symbol as a seed. More 
explicitly, the recursion is initiated with a sequence of length one having 
only one symbol 0. Then, while moving along the sequence from left to 
right, one substitutes by 01 and 1 by until the last digit is reached. One 
then repeats the same procedure ad infinitum, thus generating the infinite 
Fibonacci sequence. The first steps of the recursion yield the words 0, 01, 



6.5. The Fibonacci ladder 




(6.17) 
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010, 01001, 01001010, . . . The lengths of these finite sequences are given by 
the consecutive Fibonacci numbers: 1, 2, 3, 5, 8, 13, ... Alternatively, the 
n-th symbol of the Fibonacci sequence is given by the explicit formula 

Jl if < Frac(nr) < r- 2 , 
Vn ~ \ if t- 2 < Frac(nr) < 1, ^ } 

where Frac(x) = x — Int(x) denotes the fractional part of x, and 

v / 5 + 1 

r = — = 1.618033 (6.19) 

is the golden mean, such that r 2 = r + 1. The Fibonacci sequence is 
therefore both self-similar and quasiperiodic. It has become popular in the 
physics literature because it is a one-dimensional analogue of quasicrystals, 
discovered in 1984 [30]. The density of zeros, i.e., rungs, and ones, i.e., 
impurities, along the infinite Fibonacci ladder read p = r^ 1 = r — 1 = 
0.618033 and q = t~ 2 = 2 - r = 0.381966, respectively. 

We have considered finite Fibonacci ladders of variable length N (not 
necessarily even), with periodic boundary conditions, where the positions 
of the rungs is dictated by the impurity potentials V n from Eq. (6.18) for 
n = 1, . . . , N. A numerical diagonalization of the corresponding adjacency 
matrices leads to the following observations. The largest eigenvalue Ai keeps 
oscillating as a function of the ladder size N between the asymptotic bounds 
Amin ~ 2.6945 and A max ~ 2.7472. These oscillations appear as regular 
if Ai is plotted against the phase Frac((A + l)r) (see Figure 14). The 
modulation of the largest eigenvalue Ai as a function of N therefore follows 
the quasiperiodicity of the underlying sequence. 

The ground state (Perron-Frobenius eigenvector) tpi n also exhibits irreg- 
ular features. Its appearance varies from localized to extended as a function 
of the system size N. Figure 15 shows one typical example of each kind. As 
a general rule, the ground state looks pretty localized when Ai is close to 
Amax, i-e., when Frac((A + l)r) is close to zero. This is illustrated by the left 
panel of the figure, where N = 232 and Ai = 2.747147 ~ A max : the ground 
state appears as a symmetric impurity state localized at the boundary, i.e., 
around n = 0. On the other hand, the ground state looks pretty extended 
when Ai is close to A m i n , i.e., when Frac((A + l)r) is far from zero. This 
is illustrated by the right panel, where N = 377 and Ai = 2.694529 w A m i n : 
the ground state exhibits quite some structure, but it extends more or less 
uniformly over the whole ladder. Let us however recall that the tight- 
binding Hamiltonian (6.1) on the Fibonacci chain is known from a rigorous 
viewpoint to have a purely singular continuous spectral measure, so that 
its eigenstates are neither extended nor localized (see [31] for a review). 
Generic eigenstates are observed to be multifractal. 
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Fig. 14. Plot of the largest eigenvalue Ai of the Fibonacci ladder of size N against 
the phase Frac((7V + 1)t). 
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Fig. 15. Plot of the ground-state wavefunction ipi n in two typical examples of finite 
Fibonacci ladders. Left: N = 232, Ai = 2.747147. Right: N = 377, Ai = 2.694529. 

7. Two-dimensional examples 

In this last section, we pursue our study of MERW on extended struc- 
tures by considering a few two-dimensional situations of interest. 



7.1. Diffusion on the dual (4, 8 2 ) lattice 

We start by an investigation of the transport properties associated with 
GRW and MERW on infinite periodic lattices. The simplest non-trivial 
two-dimensional example of a non-bipartite periodic lattice is shown in Fig- 
ure 16. This lattice is dual to the (4, 8 2 ) Archimedean lattice [32, 33]. Nodes 
denoted by "•" with degree k. = 8 and nodes denoted by "o" with degree 
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k Q = 4 have equal densities. It can be checked that Ai = 2(y/b + 1), whereas 
V'l* : V'lo = (v / 5 + 1)/2. The effective degrees of the infinite lattice thus read 

K x = 6, K 2 = 2 8/3 = 6.349604, K 3 = 2(V5 + 1) = 6.472135. (7.1) 




Both GRW and MERW can be viewed as two special cases of the one- 
parameter family of discrete-time random walks defined by the following 
hopping probabilities onto neighboring nodes: 

1 + a 1 — a 1 

= - , "o» = - , P*o = ^, (7.2) 

where the parameter a is in the range — 1 < a < 1. GRW and MERW can 
be shown to correspond to a = and a = s/b — 2 = 0.236068, respectively. 

In order to investigate transport properties, it is advantageous to rewrite 
the master equation (3.1) in Fourier space. Denoting by x and y the coor- 
dinates on the lattice, we set 

P.(x,y,r) = J ^p.(u,v,T)e-^ u+ y v \ (7.3) 

and similarly for p (x,y,r), where u and v are the components of the 
wavevector, and the integral runs over the first Brillouin zone (— ir < u,v < 
7r). From Eq. (3.1) we obtain 
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with 

„, s / 4-P # . cos u cos v 2P. (cos u + cos v ) \ rN 

U(u,v) = OD / . \ n • (7.5) 

v 7 \ v 2P .(cosu + cosf) y v ' 

In the long- wavelength limit, i.e., for small u,v, the largest eigenvalue of 
this dynamical matrix departs from unity according to 

-\- iP 1 

oj(u,v) 1 1 (7.6) 

6 — a 

This behavior demonstrates that isotropic diffusion is recovered for all values 
of a. The corresponding diffusion constant, 

D(a) = (7.7) 

increases as a function of a from 1/4 to 1/2. Its values for GRW and MERW 
read 

£>grw = I = 0.333333, £>merw = = 0.361803. (7.8) 

This example shows that MERW can lead to a higher diffusion constant, 
i.e., better transport properties, than GRW on some periodic lattices. 

7.2. Designed patterns 

In order to investigate the effect of impurities on MERW in higher di- 
mensions, before going to the disordered situation of a diluted lattice, we 
find it interesting to first look at MERW on designed patterns consisting of 
simple geometrical shapes drawn on purpose. 

Figure 17 shows two examples of patterns drawn on a square lattice with 
periodic boundary conditions. The fully connected square lattice is left un- 
touched in some regions, so as to have the maximal degree 4, and hence 
no repulsive potential, whereas every second horizontal bond is removed in 
some other regions, so as to have degree 3, and hence a constant repulsive 
potential of unit magnitude. Consider first the left panel of Figure 17. The 
fully connected regions are four circles of various sizes. The stationary dis- 
tribution ir a , evaluated by numerically diagonalizing the adjacency matrix, 
is shown as levels of gray. It is clearly visible that the stationary MERW 
distribution gets localized in the largest circle. Another numerical exper- 
iment is shown in the right panel of Figure 17. This time we have four 
different shapes, all of them having the same area. The stationary distribu- 
tion is observed to localize in the circular region. To sum up, given a set of 
domains without defects (where nodes have the highest degree), a particle 
performing MERW tends to spend most of its time, and gets eventually 
localized, in the largest and most circular of these domains. 
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Fig. 17. Two examples of designed patterns drawn on a square lattice with periodic 
boundary conditions. Textured regions have a constant unit repulsive potential. 
The stationary distribution of MERW is shown as levels of gray (white: highest 
probability, black: zero probability). 



7.3. The diluted square lattice: stationary state 

We now turn to the case of the diluted square lattice, where bonds are 
removed at random with a (small) probability q. 

The Lifshitz argument presented in Section 6.4 generalizes to higher di- 
mensions [26, 27]. The ground state is expected to be localized in the largest 
Lifshitz region, i.e., nearly circular region free of defects. The quantitative 
analysis of the phenomenon goes as follows. The radius R\ of the largest 
Lifshitz region can be estimated by means of extreme- value statistics. On a 
finite system of size Lx L, the number of nearly circular regions of radius R 
with no defect is of order L 2 p 2lTR , as there are two links per node. The 
criterion that this number becomes of order unity yields 

Now, using a continuum description, the ground state in the disk of ra- 
dius R\ with Dirichlet boundary conditions is given by ip(r) ~ Jo(jr/Ri), 
where r is the distance from the center, and j = 2.404825 ... is the first zero 
of the Bessel function Jo. We thus obtain 
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The corresponding thermodynamical statement, generalizing (6.14), reads 

p( E )~exp(-H^). (7.11) 

This picture is corroborated by the data shown in Figure 18. The sta- 
tionary probability, shown as levels of gray, is observed to be localized in 
the largest nearly circular regions free of defects. Their sizes are in rough 
agreement with the estimate (7.9), yielding, respectively, Ri = 34.3, 10.8, 
4.78 and 3.34 for q = 0.001, 0.01, 0.05 and 0.1. 




Fig. 18. Density plots of the stationary distribution for MERW on a 40 x 40 
square lattice with periodic boundary conditions, for the concentrations q = 
0.001,0.01,0.05,0.1 of removed links. The endpoints of removed links are shown 
as bright dots. The stationary probability is shown as levels of gray. 

In higher dimension (d > 2), skipping lattice-dependent multiplicative 
constants, the above estimates become 

and 

where L is the linear size of the sample. Hence the stationary distribution 
of MERW on a sufficiently large d-dimensional lattice in the presence of any 
finite concentration q of disorder is localized in the largest nearly spherical 
Lifshitz region whose volume grows as InL. 
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Let us close up with a word on the weak-disorder crossover. When the 
amount of disorder gets smaller and smaller (q <C 1), the volume of the 
Lifshitz sphere diverges as Qi ~ R d ~ (In L)/q. When this estimate is of 
the order of the volume L d of the sample, MERW experiences a crossover 
between a Lifshitz localized regime (for L d S> fii, i.e., qL d 3> InL) and 
an extended regime (for L d < fix, i.e., gL d < InL). The number gL d of 
impurities needed to drive the crossover is therefore very modest, as it also 
grows as InL. 

7.4- The diluted square lattice: dynamics 

So far, we have seen that the stationary distributions for GRW and 
MERW are qualitatively different in the presence of disorder, such as a weak 
dilution. A particle performing MERW will eventually end up in the largest 
Lifshitz sphere, i.e., the largest nearly spherical region free of defects, where 
the stationary distribution is localized. Inside this region, MERW will look 
much like usual random walk, i.e., like Brownian motion on large space and 
time scales. 

In the transient regime, i.e., before the particle finds its stationary state, 
it is expected to stay for a while in some Lifshitz region, smaller than the 
optimal one but nearer to its starting point, where it will spend some time, 
before it "learns" that there is a better, albeit more distant, region else- 
where in the system, and so on. The diffusion process will thus explore a 
sequence of consecutive metastable states, depending on the initial point, 
before finally reaching the true ground state. A similar picture should hold 
for a diffusive particle in the presence of a random distribution of absorbing 
traps [27], if the observation is conditioned on the survival of the particle. 
We can therefore expect the dynamics to exhibit two different time scales, 
just as in many glassy systems (see e.g. [34]): a fast (beta) relaxation within 
each metastable Lifshitz region (where the entropy can be maximized lo- 
cally), and a slow (alpha) relaxation corresponding to tunneling between 
consecutive Lifshitz regions, until the optimal region which carries the true 
ground state is reached, so that the entropy production rate has attained 
its maximal value. 

This difference between the dynamical evolution of GRW and MERW 
is illustrated in Figure 19. A particle performing GRW (upper panels) and 
MERW (lower panels) starts at the same site of a lattice with the same 
randomly positioned defects. In the course of evolution, the generic random 
walker visits every site with a probability proportional to its degree. After 
a sufficiently long time, the probability distribution spreads more or less 
uniformly over the lattice. The stationary distribution is locally modulated 
by the presence of impurities, but it remains globally extended, just as in 
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Fig. 19. (Color online). Evolution of GRW (upper panels) and MERW (lower 
panels) on a 40 x 40 square lattice with a concentration q = 0.1 of removed links. 
Left to right: distribution after 1, 16, 128 time steps and in the stationary state. 

the case of a lattice without defects. The situation for the maximal entropy 
random walker is quite different. The particle indeed visits a sequence of 
larger and larger, albeit more and more distant regions free of defects, until 
it eventually reaches its stationary state. 
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